A Methodological View on Robustness Testing of Rule-Based Knowledge Systems
نویسندگان
چکیده
Besides the evaluation of intelligent systems with respect to the accuracy the robustness of such systems is often an important issue to consider. Robustness relates the correct output of a system to possibly incorrect input or possibly biased knowledge included in the system. In this paper we extend the approach by Groot et al. [GvHtT00] by a pre-analysis step considering the used case base and knowledge base, respectively. Appropriate measures are introduced that determine the suitability of robustness tests for a given case/knowledge base. Furthermore, we motivate that the application of background knowledge is necessary in order to obtain reliable results from robustness studies.
منابع مشابه
Necessary but Not Sufficient…; Comment on “Knowledge Mobilization in Healthcare Organizations: A View From the Resource-Based View of the Firm”
The challenge of mobilizing knowledge to improve patient care, population health and ensure effective use of resources is an enduring one in healthcare systems across the world. This commentary reflects on an earlier paper by Ferlie and colleagues that proposes the resource-based view (RBV) of the firm as a useful theoretical lens through which to study knowledge mobilization in healthcare. Spe...
متن کاملTESTING STATISTICAL HYPOTHESES UNDER FUZZY DATA AND BASED ON A NEW SIGNED DISTANCE
This paper deals with the problem of testing statisticalhypotheses when the available data are fuzzy. In this approach, wefirst obtain a fuzzy test statistic based on fuzzy data, and then,based on a new signed distance between fuzzy numbers, we introducea new decision rule to accept/reject the hypothesis of interest.The proposed approach is investigated for two cases: the casewithout nuisance p...
متن کاملGray Box Robustness Testing of Rule Systems
Due to their simple and intuitive manner rules are often used for the implementation of intelligent systems. Besides general methods for the verification and validation of rule systems there exists only little research on the evaluation of their robustness with respect to faulty user inputs or partially incorrect rules. This paper introduces a gray box approach for testing the robustness of rul...
متن کاملAn Executive Approach Based On the Production of Fuzzy Ontology Using the Semantic Web Rule Language Method (SWRL)
Today, the need to deal with ambiguous information in semantic web languages is increasing. Ontology is an important part of the W3C standards for the semantic web, used to define a conceptual standard vocabulary for the exchange of data between systems, the provision of reusable databases, and the facilitation of collaboration across multiple systems. However, classical ontology is not enough ...
متن کاملOnline Fault Detection and Isolation Method Based on Belief Rule Base for Industrial Gas Turbines
Real time and accurate fault detection has attracted an increasing attention with a growing demand for higher operational efficiency and safety of industrial gas turbines as complex engineering systems. Current methods based on condition monitoring data have drawbacks in using both expert knowledge and quantitative information for detecting faults. On account of this reason, this paper proposes...
متن کامل